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A fundamental  principle  of  the  normative  theory  of  prediction  is  that 
prior  probability,  which  summarizes  what  we  know  before  receiving  any  spe- 
cific evidence,  remains  relevant  even  after  such  evidence  is  obtained 
Recent  investigations  by  Kahneman  and  Tversky  (1973)  and  Hammerton  (1973) 
have  described  common  prediction  situations  in  which  people  deviate  from 
the  normative  prescription  by  relying  almost  exclusively  on  specific  evi- 
dence and  neglecting  prior  considerations.  Kahneman  and  Tversky  noted  that 
their  subjects'  failure  to  appreciate  the  relevance  of  prior  probability 
in  the  presence  of  specific  informal  on  was  "one  of  the  most  significant 
departures  of  intuition  from  the  normative  theory  of  prediction"  (p.  243). 

In  the  e :periments  by  Kahneman  and  Tversky,  the  subjects'  task  was  to 
estimate  the  probability  that  a target  person  belonged  to  a given  academic 
or  occupational  group.  Information  specific  to  the  case,  henceforth  re- 
ferred to  as  "individuating  information,"  was  provided  in  the  form  of  a 
short  personality  d scrip tion  such  as:  "John  is  a 45-year  old  man.  He 

is  generally  conservative,  careful,  and  ambitious.  He  shows  no  interest 
in  political  and  social  issues  and  spends  most  of  his  free  time  on  his 
hobbies  which  include  carpentry,  sailing,  and  mathematical  puzzles."  In 
this  case,  the  prior  probability,  or  base  rate,  was  varied  by  telling  sub- 
jects that  the  person  described  was  randomly  selected  from  a group  consisting 
of  either  30  engineers  and  70  lawyers  or,  in  another  condition  70  engineers 
and  30  lawyers.  Manipulation  of  the  lawyer-engineer  base  rate  was  found 
to  have  little  effect  on  subjects'  estimates  of  the  probability  that  the 
description  was  that  of  an  engineer.  Kahneman  and  Tversky  argued  that 
these  probabiiity  estimates  depended,  instead,  upon  the  degree  of  simi- 
larity between  the  description  and  the  subjects'  stereotypes  for  engineers 
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and  lawyers.  Kahneraan  and  Tversky  further  noted  that  predicting  outcomes 
according  to  their  similarity  to  the  individuating  evidence  reflects  a 
general  heuristic  principle  that  people  use  when  making  probabilistic  judg- 
ments. This  heuristic,  which  they  called  "representativeness,"  leads  to 
a variety  of  systematic  errors  and,  in  this  task,  caused  judgments  to 
neglect  prior  probabilities. 

Hammerton  independently  found  a similar  result.  He  presented 
subjects  with  six  statements  such  as  the  following: 

(1)  A device  has  been  invented  to  test  for  Disease  X. 

(2)  The  device  is  a very  good  one,  but  not  perfect. 

(3)  If  someone  suffers  from  X,  there  is  a 90%  chance  he  will  test 
positively. 

(4)  If  he  is  not  a sufferer,  there  is  still  a 1%  chance  that  he  will 
be  recorded  positively. 

(5)  Roughly  1%  of  the  population  has  the  disease. 

(6)  Mr.  Smith  has  been  tested  and  the  result  is  positive. 

Hammer ton's  subjects  were  then  asked  to  indicate  the  probability  that 
Mr.  Smith  has  Disease  X.  The  probability  of  Disease  X,  given  a positive 
test  result,  <.  in  be  computed  from  Bayes'  Theorem  on  the  basis  of  the  in- 
formation in  Statements  3,  4,  and  5.  The  Bayesian  probability  turns  out 
to  be  .48.  Subjects  greatly  overestimated;  their  median  probability  was 
.85.  In  case  the  reader's  perceptions  follow  the  subjects',  the  veracity 
of  the  Bayesian  calculation  is  illustrated  by  the  2X2  diagram  in  Table  1, 
showing  the  expected  results  from  10,000  test  cases. 


Insert  Table  1 about  here 
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The  judgments  of  Hammerton's  subjects  seemed  to  be  dominated  by  the 
conditional  probability  in  the  upper  rov  of  Table  1,  rather  than  the  con- 
ditional probability  in  the  left  colu/in.  The  subjects'  misunderstanding 
was  further  demonstrated  when  Hammei  ton  removed  various  combinations  of 
Statements  3,  4,  and  5 from  the  problem  description,  thus  rendering  the 
problem  unsolvable,  but  left  one  item  of  individuating  information  (State- 
ment 2).  Subjects  still  unaswered  with  median  probabilities  between  .75 
and  .90.  Furthermore,  these  answers  were  given  with  a high  degree  of 
confidence ! 

Hammerton's  results,  showing  that  subjects'  estimates  were  dominated 
by  the  diagnosticity  of  the  individuating  data,  are  similar  to  those  of 
Kahneman  and  Tversky.  However,  Hammerton  interpreted  them  somewhat  dif- 
ferently. He  argued  that  subjects  entered  the  experiment  with  a "rigid 
prior"  expectation  that  diagnostic  tests  are  infallible.  He  attempted 
to  support  this  conjecture  in  a second  study  in  which  the  content  of  the 
problem  was  changed  to  reduce  the  likelihood  of  subjects  having  strong 
prior  expectations  about  diagnostic  infallibility.  Statement  1 was  changed 
to  read:  "A  device  has  been  invented  for  screening  engine  parts  for  in- 

ternal cracks."  The  other  statements  were  altered  to  match,  but  the 
probabilities  in  the  statements  remained  the  same.  Subjects'  median  prob- 
ability that  an  engine  with  a positive  test  result  was  cracked  was  .60 — 
significantly  lover  than  the  .85  typical  of  the  medical  problem,  yet  still 
higher  than  the  Bayesian  answer.  Hammerton  concluded  that,  although  sub- 
jects still  underweighted  the  base  rate,  this  effect  of  changing  content 
supported  his  hypothesis  about  "rigid  priors." 

Hammerton's  results  suggest  that  the  dominance  of  individuating  infor- 
mation may  be  affected  by  the  content  of  the  problem.  Further  investigation 
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ot  content  seems  warranted,  and,  in  this  regard,  a pilot  study  done  by 
Kahneman  and  Tversky  (Note  1)  is  relevant.  They  gave  subjects  the  fol- 
lowing problem: 

Two  cab  companies,  the  Blue  and  the  Green,  operate  in 
a given  city.  Eighty-give  percent  of  Mie  cabs  in  the  city  are 
Blue,  and  the  remaining  15%  are  Green.  A cab  was  involved  in 
a hit  and  run  accident  at  night. 

A witness  identified  the  cab  as  a Green  cab.  The  court 
tested  his  ability  to  distinguish  a Blue  cab  from  a Green  cab 
at  night,  and  found  that  he  was  able  to  make  correct  ideitifi-- 
ca^ions  in  four  out  of  five  tries. 

What  do  you  think  is  the  probability  (expressed  as  a per- 
centage) that  the  cab  involved  in  this  accident  was  Blue? 

The  median  estimated  probability  that  the  cab  was  Blue  was  .20,  indi- 
cating that,  here  too,  subjects  ignored  base  rate  information  and  relied 
on  the  individuating  information  about  the  witness'  accuracy.  This  study, 
and  Hammer ton' s , suggest  that  judgments  can  be  dominated  by  individuating 
information  in  numerical  form  as  well  as  by  the  verbal  des zriptions  in 
Kahneman  and  l Kursky's  other  problems.  But  the  presence  of  this  individu- 
ation effect  in  the  CaW  Problem,  where  no  "rigid  prior"  about  witness' 
infallibility  would  be  expected,  brings  Hammerton's  explanation  into  question. 

At  ttiis  point,  delineation  of  the  conditions  under  which  prior  infor- 
amtion  is  used  or  discarded  seems  to  merit  further  investigation.  The 
present  study  employed  Hammerton's  problems  and  several  variations  of  the 
Cab  Problem  to  test  hypotheses  about  variables  that  could  mitigate  the 
effect.  Specifically,  problem  content  was  varied.  In  addition,  base  rates 
and  individuating  accuracies  were  expressed  as  percentages  in  some  prob- 
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lems  and  small  numbers  in  others.  Extreme  base  rates  were  studied.  Random 
sampling  from  the  population  in  question  was  emphasized.  Individuating 
evidence  that  was  congruent  with  the  base  rate  was  studied,  as  well  as 
evidence  in  opposition  to  the  base  rate.  Order  of  presentation  and  res- 
ponse format  were  also  varied. 

Neglect  of  prior  probabilities  in  all  these  circumstances  would  have 
considerable  theoretical  and  practical  importance.  Theoretical  import 
stems  from  the  role  these  findings  would  play  in  evaluating  Hammerton's 
views  about  content  and  Kahneman  and  Tversky's  hypothesis  about  represen- 
tativeness as  a determiner  of  subjective  probability.  Practical  benefits 
would  accrue  from  the  recognition  and  correction  of  a systematic  error 
which  has  potentially  serious  consequences  for  decision  making.  As  Kahne- 
man and  Tversky  state  with  regard  to  the  Cab  Problem:  "Much  as  we  would 

like  to,  we  have  no  reason  to  believe  that  the  typical  juror  does  not 
evaluate  evidence  in  this  fashion"  (Note  1,  p.  13). 

Method 

The  experiment  employed  numerous  variations  of  the  Cab  Problem.  The 
basic  problem  was  modified  to  read  as  follows: 

Two  cab  companies,  the  Blue  and  the  Green,  operate  in  a given 
city.  Eighty-five  percent  of  the  cabs  in  the  city  are  Blue,  and 
i he  remaining  15%  are  Green.  A cab  was  involved  in  a hit-and-run 
accident  at  night.  A witness  identified  the  cab  as  a Green  cab. 

The  court  tested  the  witness'  ability  to  distinguish  a Blue 
cab  from  a Green  cab  at  night  by  presenting  to  him  film  sequences, 
half  of  which  depicted  Blue  cabs,  and  half  depicting  Green  cabs. 

He  was  able  to  make  correct  identification  in  8 out  of  10  tries. 


He  made  one  error  on  each  color  of  cab. 


1 

1 
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What  Jo  you  think  is  the  probability  (expressed  as  a per- 
centage) that  the  cab  involved  in  this  accident  was  Blue? 

Ibis  modification  of  the  original  problem  was  designed  Lo  specify 
that  the  witness'  accuracy  was  estimated  by  the  court  test  to  be  .8 
regardless  of  the  true  color  of  the  cab.  Without  specifying  the  wit- 
ness accuracy  conditional  upon  each  of  the  colors  being  true,  the  prob- 
lem does  not  have  a unique  Bayesian  solution.  With  it,  the  Bayesian 
probability  that  the  cab  is  Blue,  given  the  witness  says  Green,  is  .59 
(see  Table  2). 

Insert  Table  2 about  here 

Variations 

Incidental  features.  Two  incidental  features  of  the  Cab  Problem  were 
changed  to  establish  whether  they  were  influencing  the  judgments.  Order 
of  presentation  was  varied  by  giving  the  individuating  information  before 
the  base  rate  information.  The  question  in  the  standard  problem  was  also 
changed  to  ask  for  the  probability  that  the  cab  involved  was  Green. 

Confirming  evidence.  In  the  standard  Cab  Problem,  the  witness'  testi- 
mony goes  counter  to  the  base  rate.  Two  versions  of  the  problem  were 
studied  in  which  the  witness  claimed  that  the  cab  was  Blue,  thus  con- 
firming the  implication  of  the  base  rate.  In  one  version,  the  base  rate 
was  kept  at  85%  Blue,  but  the  witness'  accuracy  was  lowered  to  60%.  In 
the  other  version  the  base  rate  was  lowered  to  60%  Blue,  but  the  witness' 
accuracy  was  80%. 

Base  rate  alone.  Kahneman  and  Tversky  reported  that,  when  individ- 
uating information  was  uosent,  subjects  correctly  used  the  base  rate. 

To  verify  this  result,  one  version  of  the  Cab  Problem  had  the  witness' 
statement  deleted. 


k 
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Contojit.  Another  problem  was  created,  similar  to  the  Cab  Problem 
In  structure  but  not  content.  The  "Light -Blub  Problem"  takes  the  sit- 
uation out  of  a court  of  law,  employs  a mechanical  "witness,"  emphasizes 
random  selection  from  the  population,  and  presents  the  invididuating  in- 
formation as  the  base  rate  is  given,  i.e.,  as  a percentage.  It  read  as 
follows : 

A light  bulb  factory  uses  a scanning  device  which  is  supposed 
to  put  a mark  on  each  defective  bulb  it  spots  in  the  assembly 
line.  Eighty-five  percent  of  the  light  bulbs  on  the  line  are 
OK;  the  remaining  15%  are  defective. 

When  a bulb  is  good,  the  scanner  correctly  identifies  it  as 
good  80%  of  the  time.  When  a bulb  is  bad,  the  scanner  correctly 
marks  it  80%  of  the  time. 

Suppose  someone  selects  one  of  the  light  bulbs  from  the  line 
at  random  and  gives  it  to  the  scanner.  The  scanner  marks  this 
bulb  as  defective. 

What  do  you  think  is  the  probability  (expressed  as  a percentage) 
that  this  bulb  is  really  OK? 

One  version  of  this  problem  presented  the  individuating  information 
in  the  same  manner  as  the  Cab  Problem,  saying  that  the  scanner  was  able 
to  correctly  identify  the  condition  of  the  bulb  in  eight  out  of  ten 
trials,  and  it  made  one  error  on  each  kind  of  bulb.  A second  version 
of  this  problem  had  the  phrase  "at  random"  deleted. 

As  a further  test  of  content  effects,  Hammerton’s  Disease  Problem 
and  Engine-Crack  Problem  were  also  studied  here. 

Base  rate  extremity.  Several  additional  versions  of  the  Light-Bulb 
Problem  were  studied.  The  base  rate  of  defective  bulbs  was  made  1 in  100, 
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instead  of  15  Jn  100,  and  one  group  estimated  the  probability  that  the 
bulb  was  good  while  a second  group  estimated  the  probability  that  it  was 
defective,  given  individuating  evidence  calling  it  defective. 

Base  rate  Jformat.  Another  Light -Bulb  problem  attempted  to  individuate 
the  base  rate  by  presenting  it  in  a form  similar  to  the  presentation  of 
individuating  information  in  the  standard  Cab  Problem.  The  crucial  sen- 
tence read:  "Suppose  there  are  10  bulbs  to  be  tested.  Eight  of  these 

are  O.K.  The  other  two  are  defective." 

Base  rate  salience.  Another  problem  was  developed  to  test  the  hypo- 
thesis that  well  established  or  easily  remembered  (i.e.,  salient)  base 
rates  might  be  incorporated  into  the  relevant  impression  and  thus  be 
given  more  weight  in  the  estimate. 

The  'Right-Hander"  Problem  began  as  follows: 

A knifing  incident  was  recently  the  subject  of  a jury 
trial  in  a particular  city.  A .entral  issue  in  the  case 
was  whether  the  assailant  was  right-handed  or  left-handed. 

About  85%  of  the  population  of  the  city  is  right-handed; 
the  remaining  15%  are  left-handed. 

A witness  testified  in  court  that  the  attacker  had  held 
the  knife  in  his  left  hand 

The  remainder  of  the  problem  paralleled  the  structure  for  the  other 
problems,  with  the  witness  being  shown,  by  court  test,  to  be  80%  accurate 
m his  ability  to  determine  both  left  and  right  handed  assailants  under 
circumstances  similar  to  those  in  question.  The  subject  was  then  asked 
to  estimate  the  probability  that  the  assailant  was  right  handed. 

Response  format.  Each  of  the  variations  described  above  asked  the 
subject  to  answer  in  terms  of  a probability  or  a percentage.  To  provide 
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a broader  perspective  on  subjects'  attitudes  toward  the  relevance  of  base 


rates  and  individuating  information,  the  basic  Cab  Problem  and  the  Light- 


Bulb  Problem  were  also  studied  with  multiple-choice  formats  in  which  three 


opposing  positions  were  stated.  For  example,  in  the  Cab  Problem,  subjects 


were  asked: 


What  do  you  think  is  the  probability  (expressed  as  a per- 


centage) that  the  cab  involved  in  this  accident  was  Blue? 


Indicate  (by  marking  with  an  X)  which  of  the  following  three 


answers  best  represents  your  opinion. 


a.  Since  the  witness  was  80%  accurate  in  the  court  test. 


the  probability  that  the  cab  which  committed  this  crime  is 


Blue  is  about  20%.  The  proportion  of  Blue  and  Green  cabs  in 


the  city  is  irrelevant  because  it  says  nothing  about  the  par- 


ticular cab  involved. 


_b.  Since  85%  of  the  cabs  in  the  city  are  Blue  the  proba- 


bility that  the  cab  which  committed  this  crime  is  Blue  is  about 


c.  The  witness'  statement  and  the  proportion  of  Blue  and 


Green  cabs  in  the  city  are  equally  important.  Since  these  two 


items  of  information  point  toward  different  conclusions,  they 


offset  one  another.  Therefore,  the  probability  that  the  cab 


which  committed  this  crime  is  Blue  is  about  50%. 


How  confident  are  you  that  your  answer  is  appropriate?  Mark 


one  response. 


1 2 
Not  at  all 
confident 


Moderately 

Confident 


5 

Very 

Confident 
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Subjects 

The  basic  Cab  Problem,  its  variations,  and  the  two  Hammerton  prob- 
lems were  presented  in  group  ; ettings  to  a total  of  310  volunteers  en- 
rolled in  psychology  classes  at  the  University  of  Oregon,  and  to  242  paid 
subjects  at  the  Oregon  Research  Institute.  Each  subject  saw  onxy  one 
problem,  in  written  form. 

Results 

Since  there  was  no  diseernable  difference  between  the  results  from 
paid  and  volunteer  subjects,  data  from  both  types  of  subjects  were  combined 
and  are  shown  in  Table  3.  The  standard  version  of  the  Cab  Problem  (line 
1)  produced  results  similar  to  those  obatined  by  Kahneman  and  Tversky . 

The  median  and  modal  estimate  was  20%  probability  of  Blue,  thus  con- 
firming the  tendency  of  subjects  to  neglect  the  base  rate  and  rely  pre- 
dominantly on  the  witness.  Placing  the  individuating  information  first 
(line  2)  or  asking  subjects  to  estimate  the  probability  that  the  cab  was 
Green  (line  3)  had  no  significant  effect  on  the  dominance  of  the  indivi- 
duating information.  The  results  shown  on  lines  4 and  5 indicate  that 
individuating  evidence  which  confirmed  the  base  rate  was  equally  dominant. 

When  the  confirming  witness  was  said  to  be  60%  accurate,  subjects  tended 
to  estimate  the  probability  of  Blue  at  60%,  and  when  the  confirming  witness 
was  termed  80%  accurate,  subjects  median  estimate  was  80%. 

Insert  Table  3 about  here 

As  in  the  experiments  by  Kahneman  and  Tversky,  the  present  subjects 
did  use  the  base  rate  information  when  no  individuating  evidence  was  pro- 
vided (line  6). 
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Turning  to  the  Light  Bulb  Problems,  the  change  in  cover  story  (line 
7^,  emphasis  on  random  selection  (line  8),  and  change  in  the  base  rate 
format  (line  9)  all  had  little  or  no  effect.  The  median  estimates  for 
each  problem  matched  tne  individuating  accuracies  exactly.  Describing 
the  individuating  accuracy  as  eight  out  of  ten  correct,  rather  than  80% 
correct,  also  made  no  difference  in  the  results. 

When  subjects  estimated  the  probability  thaL  the  bulb  was  good,  the 
problem  with  the  extreme  base  rate  (line  10)  produced  a somewhat  higher 
median  probability  estimate  than  did  the  comparable  problem  with  the  less 
extreme  base  rate  (line  8).  However,  the  difference  between  medians  was 
not  statistically  significant  (X?  = 2.12;  df  = 1;  p > .05).  Furthermore, 
when  subjects  estimated  the  probability  that  the  bulb  was  defective  (line 
11)  they  followed  the  individuating  information  very  closely  despite  the 
extreme  base  rate. 

The  salience  manipulation  (line  12)  failed  to  alter  subjects'  reliance 
on  the  individuating  information.  The  responses  to  both  of  Hammerton's 
problems  (lines  13  and  14)  were  dominated  by  the  individuating  infor- 
mation, leading  subjects'  estimates  to  exceed  greatly  the  Bayesian  answer 
of  .48.  In  contrast  to  Hammerton's  results,  there  was  no  significant  tend- 
ency in  the  present  data  for  the  Disease  Problem  to  elicit  higher  proba- 
bility estimates  than  the  Engine-Crack  Problem. 

The  response  to  the  multiple-choice  versions  of  the  Cab  and  Light - 
Bulb  Problems  are  presented  in  Table  4.  Both  problems  produced  similar 
results.  The  most  frequent  answer  was  a,  which  followed  the  individuating 
information  exactly  and  asserted  that  the  base  rate  was  irrelevant.  Re- 
ponse  b,  which  followed  the  base  rate,  was  chosen  least  often  in  both 
problems.  Response  c,  which  stated  that  both  types  of  information  were  im- 
portant ) was  given  by  about  37%  of  the  subjects  tested  on  the  two  problems.  This 
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percentage  can  be  contrasted  with  the  13%  of  the  subjects  whose  estimates 
fell  in  the  middle  range  (40%-60%)  on  problems  1 and  8 in  Table  3,  which 
were  comparable  except  for  the  multiple-choice  format.  The  difference 
in  proportions  is  statistically  significant  (Z  = 3.12;  p < .001),  and  sug- 
gests that  there  may  be  a little  more  (but  by  no  means  adequate)  appre- 
ciation of  the  importance  of  the  base  rate  than  is  implied  by  the  results 
of  the  direct  estimation  (non-multiple-choice)  format.  Table  4 also  indi- 
cates that  subjects  were,  on  the  average,  moderately  confident,  regardless 
of  which  answer  they  chose. 

Insert  Table  4 about  here 


Discussion 

The  present  study  indicates  that  the  dominance  of  individuating  infor- 
mation over  prior  probabilities  is  a robust  phemonemon,  impervious  to 
incidental  features  of  the  basic  inference  task  as  well  as  to  major  changes 
in  the  content  of  the  problem.  Thf  irrelevance  of  content  casts  doubt 
upon  Hammerton's  hypothesis  about,  the  importance  of  the  certain  types  of 
individuating  information.  All  types  were  found  here  to  be  dominant. 

A further  weakness  of  Hammer  ton's  explanation  is  its  assumption  that  sub- 
jects' prior  expectations  about  specific  information  are  learned  from 
experience.  Since  the  world  operates  according  to  Bayes'  Theorem,  ex- 
perience should  confirm  the  importance  of  base  rates.  In  light  of  these 
difficulties,  the  representativeness  hypothesis  remains  the  most  attractive 
general  explanation  of  the  present  results. 

The  representativeness  hypothesis  predicts  that  probability  esti- 
mates will  be  determined  by  the  most  salient  feature  of  the  evidence  which, 
in  these  problems,  is  the  stated  accuracy  of  the  witness  or  testing  device. 
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When  evidence  specific  to  a case  is  known  to  be  correct  will,  probability 
£,  few  persons  recognize  that  base  rate  considerations  work  to  make  the 
accuracy  dependent  upon  which  state  the  evidence  implies.  People  are 
confident  that  a device  which  is  80%  accurate  regardless  of  the  true  state, 
is  always  80%  accurate.  It  appears  to  be  so  simple  that  they  wonder  why 
anyone  would  even  question  the  stated  probability. 

One  might  expect  a misunderstanding  as  pervasive  as  this  to  be  obser- 
vable beyond  the  confines  of  this  study,  in  the  world  where  professionals 
make  decisions  of  importance  to  society.  It  is.  Several  decades  after 
the  beginning  of  the  psychometric  movement,  Meehl  and  Rosen  (1955)  found 
it  necessary  to  point  out  the  fallaciousness  of  trying  to  assess  the  pre- 
dictive validity  of  a psychological  test  on  the  basis  of  hit  rate  alone, 
without  reference  to  base-rate  considerations.  Insensitivity  to  the  ef- 
fects of  prior  probabilities  was  a common  shortcoming  of  test  developers 
and  users,  as  Meehl  and  Rosen  showed. 

The  lesson  that  Meehl  and  Rosen  taught  psychometricians  holds  as  well 
for  any  domain  in  which  judges  attempt  to  use  their  expertise  to  predict* 
low  base-rate  phenomena.  Unless  the  judge  is  extremely  accurate  regard- 
less of  the  true  state,  he  is  more  likely  to  be  wrong  than  right  when  he 
predicts  the  rare  event.  The  type  of  misunderstanding  observed  in  the 

present  study  may  help  explain  why  people  so  often  predict,  with  confidence, 
rare  events. 

Finally,  the  contrast  between  the  present  results  and  the  conservatism 
found  in  other  studies  or  probabilistic  judgment  (e.g.,  Edwards,  1968) 
deserves  comment.  In  those  studies,  subjects  typically  observed  samples 
of  data  drawn  from  one  of  several  sources.  Their  task  was  to  estimate 
the  probability  that  a particular  source  was  generating  the  data.  These 
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estimates  were  found  to  stay  too  close  to  the  prior  probability  for  the 
source — hence  the  label  conservatism.  However,  later  analyses  (hahneman 
& I’versky,  1972;  Slovic  & Lichtenstein,  1571)  showed  that  subjects'  con- 
servatism in  t lese  tasks  resulted  fr jm  improper  operations  which  they 
performed  on  the  sample  data,  rather  than  from  overweighting  of  prior 
probabilities.  Thus,  the  contrast  between  the  "conservatism  studies" 
and  the  present  study  mav  be  more  apparent  than  real.  In  both  types  of 
problems, subjects'  lack  of  insight  leads  them  to  neglect  prior  probabili- 
ties and  rely  almost  exclusively  on  specific  evidence. 
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Table  1 


Expected  Results  from  10,000  Simulations 
of  the  Hammerton  Problem 


Test  Say^ 

+ 

100 
9900 

Probability  of  disease  given  positive  test  score  = 90/(90+99)  = .48 


Table  2 


Expected  Results  from  100  Simulations 
of  the  Cab  Problem 

Witness  Says 


Blue 

Green 

True 

Blue 

68 

17 

Color 

Green 

3 

12 

Probability  that  True  Color  is  Blue  given  witness  says  Green  = 17/(17+12)  = .59 
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Results  from  the  Cab  Problem,  Its  Variations,  and  the  Hammerton  Problems 
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Table  4 


DisLribuL Ion  of 

Responses 

to  the  Mu  1 1 1 pi  e-Clio  1 <■« 

• Problems 

Cab  Problem 

Light 

Bulb  Problem 

Response 

Frequency 

Mean 

Confidence 

Response 

Frequency 

Mean 

Confidence 

a.  (20%) 

14 

3.3 

a.  (20%) 

12 

3.4 

b.  (85%) 

4 

3.0 

b.  (85%) 

3 

3.0 

c.  (about  50%) 

9 

3.2 

c.  (about  50%) 

10 

3.0 
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